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Huge Unimodular N-Fold Programs 


Shmuel Onn * Pauline Sarrabezolles ^ 


Abstract 

Optimization over I x m x n integer 3-way tables with given line-sums is 
NP-hard already for fixed I = 3, but is polynomial time solvable with both I, m 
fixed. In the huge version of the problem, the variable dimension n is encoded 
in binary, with t layer types. It was recently shown that the huge problem can 
be solved in polynomial time for fixed t, and the complexity of the problem 
for variable t was raised as an open problem. Here we solve this problem and 
show that the huge table problem can be solved in polynomial time even when 
the number t of types is variable. The complexity of the problem over 4-way 
tables with variable t remains open. Our treatment goes through the more 
general class of huge n-fold integer programming problems. We show that huge 
integer programs over n-fold products of totally unimodular matrices can be 
solved in polynomial time even when the number t of brick types is variable. 


1 Introduction 

Consider the following optimization problem over 3-way tables with given line-snms: 
mm{wx : x G ^ Xij^k = ej^k , ^ Xij^k = fi,k , ^ Xij^k = gi,j} ■ 

i j k 

It is NP-hard already for I = 3, see [3]. Moreover, every bonnded integer program 
can be isomorphically represented in polynomial time for some m and n as some 
3 X mx n table problem, see [1]. However, when both /, m are hxed, it is solvable in 
polynomial time [21 El [10], and in fact, in time which is cnbic in n and linear in the 
binary encoding of w,e,f,g, see [7]. Assnme thronghont then that l,m are hxed, 
and regard each table as a tnple x = (x^,..., x”) consisting of n many I x m layers. 
The problem is called huge if the variable nnmber n of layers is encoded in binary. 
We are then given t types of layers, where each type k has its cost matrix G , 
colnmn-snms vector G and row-snms vector G Z^_^. In addition, we are 
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given positive integers ni,..., n*, n with ni + • • • + nt = n, all encoded in binary. 
A feasible table x = (x^,... then must have hrst ni layers of type 1, next n 2 
layers of type 2, and so on, with last rit layers of type t. The special case of t = 1 is 
the case of symmetric tables, where all layers have the same cost, row and column 
sums, and the classical (non-huge) table problem occurs as the special case oit = n 
and rii = ■ ■ ■ = fit = 1. Note that for each /c, the set of possible layers of type k is 



and may have cardinality which is exponential in the binary encoding of e^, f^. So 
it is not off hand clear how to even write down a single table, let alone optimize. 

The huge table problem was recently considered in m, where it was shown, 
combining results of [21 |8l |T0] on Graver bases and results of mu on integer cones, 
that it can be solved in polynomial time for hxed t. The complexity of the problem 
for variable t was raised as an open problem. Here we solve this problem and show 
that the huge table problem can be solved in polynomial time even when t is variable. 

Theorem 1.1 The huge 3-way table problem with a variable number t of types can be 
solved in time which is polynomial in t and in the binary encoding ofw^, e^, /^, g, n^. 

It was moreover shown in m that the huge d-table problem over mi x • • • md-ixn 
tables with mi,... nid-i hxed and n variable can also be solved in polynomial time 
for any hxed number t of types. Interestingly, we do not know whether Theorem 11.11 
could be extended to this more general situation, and the complexity of the huge 
d-way table problem with variable t remains open, already for 3 x 3 x 3 x n tables. 


Theorem 11.11 follows from broader results which we proceed to describe. The class 
of n-fold integer programming problems is dehned as follows. The n-fold product of 
an s X d matrix A is the following (d -|- sn) x (dn) matrix, with / the d x d identity. 




/ I I 
A 0 
0 A 


I \ 

0 

0 


\ 0 0 



The classical n-fold integer programming problem is then the following: 


min [wx : x G Z'^"' , A^'^^x = b , I < x < u} , (1) 

where w G Z'^"', b G Z'^+^"', and /,n G ZJ^ with Z^o := Z l±) {±cxo}. For instance, 
optimization over multiway tables is an n-fold program, as is explained later on. 
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Our starting point is the following result on classical n-fold integer programming, 
established in I2li, building on results of mum- See the monograph [10] for a 
detailed treatment of the theory and applications of n-fold integer programming. 

Proposition 1.2 For fixed matrix A, the classical n-fold integer programming prob¬ 
lem m can be solved in time polynomial in n and the binary encoding ofw,l,u,b. 

This result holds more generally if the identity I in the dehnition of is replaced 
by another hxed matrix B. Moreover, recently, in |^, it was shown that the problem 
can be solved in time which is cubic in n and linear in the binary encoding oiw,b,l,u. 

The vector ingredients of an n-fold integer program are naturally arranged in 
bricks, where w = {w ^,..., w"') with tc* G for z = 1,..., n, and likewise for I, u, 
and where b = {W, F,... ,h'^) with 6° G and 6* G for z = 1,..., n. Call an 

n-fold integer program huge if n is encoded in binary. More precisely, we are now 

given t types of bricks, where each type k = 1,... ,t has its cost G Tfi, lower and 
upper bounds l^,u^ G and right-hand side b^ G Also given are G Tfi and 
positive integers ni,..., n*, n with ni n* = n, all encoded in binary. A feasible 

point X = ..., x”) now must have hrst ni bricks of type 1, next n 2 bricks of type 

2, and so on, with last Ut bricks of type t. Classical n-fold integer programming 

occurs as the special case of t = n and ni = • • • = n* = 1, and symmetric n-fold 
integer programming occurs as the special case of f = 1. We show the following. 

Theorem 1.3 Let A be a fixed totally unimodular matrix and consider the huge 
n-fold program over A with a variable number t of types. Then the optimization prob¬ 
lem can be solved in time polynomial in t and the binary encoding ofw^, l^,u^,b^,nk. 

The rest of the article is organized as follows. In Section 2 we discuss the fea¬ 
sibility problem which is easier than the optimization problem and admits a more 
efficient algorithm. In Section 3 we discuss the optimization problem, using the 
results on feasibility. We conclude in Section 4 with further discussion of tables. 

2 Feasibility 

In this section we consider the feasibility problem for huge n-fold integer programs: 

is {x G = b, I < x < u} nonempty ? 

We begin with the case of symmetric programs, with one type, so that t = 1, 
over an s X d totally unimodular matrix A. So the data here consists of the top 
right-hand side a G and for all bricks the same lower and upper bounds /, n G 
and same right-hand side 6 G Z*. Then the set in question can be written as 

■|x G Z'^”' : X* = a , Ax* = b, I < x^ < u , i = 1,..., nj’ . (2) 
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We have the following lemma. 

Lemma 2.1 Let A be totally unimodular. Then the set in ^ is nonempty if and 
only if Aa = nb and nl < a < nu, and this can be decided in time that is polynomial 
in the binary encoding of n, I, u, a, b, even when A is a variable part of the input. 

Proof. Suppose hrst that the set in (j2]) contains a feasible point x = ... jX”). 

Then Aa = A nl < a = Yll=i ^ For the 

converse we use induction on n. Suppose a satishes the conditions. If n = 1 then 
:= a is a feasible point in ([2]). Suppose now n>2. Consider the system 

I ^ y ^ u , Ay = b , {n — 1)1 < a — y < {n — l)u 

in the variable vector y. Then y = is a real solution to this system, and therefore, 
since A is totally unimodular, there is also an integer solution x"^ to this system. In 
particular, Ax^ = b and I < x^ < u. Let d := a—x”. Then Ad = A{a—x"') = {n—l)b 
and (n — 1)/ < a = a — x"’ < (n — 1 )m. It therefore now follows by induction that 
there is an integer solution (x^,..., x"'~^) to the {n — l)-fold program 

<|x e ^ X* = a , ylx* = b, I < x^ < u , i = l,...,n — l| . 

Then = d + x"' = a and therefore x := (x^,..., x”“^, x”) is a feasible point 

in ([2]). The statement about the computational complexity is obvious. □ 

We proceed with the general case of t types. So the data now consists of 6° G 
and for A: = 1,..., t, lower and upper bounds l’^,u^ G right-hand side b^ G Z^, 
and positive integer Ufc, with ni + - ■ ■ + nt = n. We denote by IiW- ■ -tbl/i = {1,..., n} 
the natural partition with \Ik\ = Uk- So the set in question can be now written as 

|x G Z'^’* : ^ X* = 6° , v4x* = /^ < X* < A; = 1,..., t, z G /fcj . (3) 

We have the following theorem asserting that when A is totally unimodular the 
feasibility problem is decidable in polynomial time even if the number t of types 
is variable. The algorithm underlying the proof uses only classical n-fold integer 
programming and avoids the heavy results of [6] on integer cones used in [IT] . 

Theorem 2.2 Let A be a fixed totally unimodular matrix and consider the huge 
n-fold program over A with variable number t of types. Then it is decidable in time 
polynomial in t and the binary encoding ofl’^, 6^, nk, if the set in ^ is nonempty. 
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Proof. Consider the following set of points of a classical f-fold integer program: 

yez'^^ : = Ay^ = n,b\ < y'^ < n^u\ . (4) 

k=l J 

We claim that ([3]) is nonempty if and only if (|3]) is nonempty, which can be decided 
within the claimed time complexity by Proposition 11.21 on classical n-fold theory. 

So it remains to prove the claim. First, snppose x is in ([3]). Define y by setting 
y^ := ^ ^ Then we have = 

X* = Ukb^, and < y^ = X* < rikU^, so y is in (jl]). Conversely, 

snppose y is in (jl]) . For k = 1,... ,t consider the symmetric n^-fold program 

(xC i e Ik) e = y^ , Ax^ = b^ , < P < , i e h 

iSik 

Since ?/ is in (|1|) we have that Ay^ = rikb^ and Ukl^ < 2/^ < rikU^- Therefore, 
by Lemma 12.11 this program is feasible and has a solntion (x* : i G Ik)- Let 
X = (x^,..., x^) be obtained by combining the solntions of these t programs. Then 
we have /^ < x* < for A: = 1,..., t 

and z G Jfc, so X is in dl]). This completes the proof of the claim and the theorem. □ 



3 Optimization 

In this section we consider the optimization problem for hnge n-fold programs: 

{ t n 

w'^x'- : X G Z"*”, X* = 6°, Ax* = 6^, Z*' < X* < A; = 1,..., f, z G 4 

k=l i£lk *=1 

The optimization problem is harder than the feasibility problem in that we need 
to actnally prodnce an optimal solntion if one exists. Since the problem is hnge, 
meaning that n is encoded in binary, we cannot explicitly even write down a single 
point X G Z'^” in polynomial time. Bnt it tnrns ont that we can present x compactly 
as follows. For k = 1,... ,t the set of all possible bricks of type k is the following 

S’^ := G Z'^ : Az = b\ <z< u’^} . 

We assnme for simplicity that is finite for all k, which is the case in most ap¬ 
plications, snch as in mnltiway table problems. Let := (A^ : z G 5^) be a 
nonnegative integer tnple with entries indexed by points of Each feasible point 
X = (x^,...,x"') gives rise to A^,...,A* satisfying ^ ^ where 
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is the number of bricks of x of type k which are equal to z. Let the support of 
be supp(A^) := {z E ^ 0}. Then a compact presentation of x consists 

of the restrictions of A^ to supp(A*^) for all k. While the cardinality of may be 
exponential in the binary encoding of the data u^, it turns out that a compact 
presentation of polynomial size always exists. The following theorem was shown in 
[TT| using the recent computationally heavy algorithm of [B] which builds on |S]. 

Proposition 3.1 For fixed d and t, the huge n-fold integer optimization problem 
with t types, over an sx d matrix A which is part of the input, can be solved in poly¬ 
nomial time. That is, in time polynomial in the binary encoding of A, l^,u^,b^,nk, 
it can either be asserted that the problem is infeasible, or a compact presentation 
A^,..., A* of an optimal solution with |supp(A^)| < 2'^ for k = 1,... ,t be computed. 

We now show that for a totally unimodular matrix, we can solve the huge problem 
even for variable t, extending both the above result and classical n-fold theory. 

Theorem 11.31 Let A be a fixed totally unimodular matrix and consider the huge 
n-fold program over A with a variable number t of types. Then the optimization prob¬ 
lem can be solved in time polynomial in t and the binary encoding ofw^, l^,u^,b^,nk. 

Proof. Consider the following classical f-fold integer optimization problem: 

{ t t 

Y,■■ y ez'"*, Yy'^ = ^y" = ^y'^k = i,...,t 

k=l k=l 

By Proposition 11.21 on classical n-fold theory we can either assert the problem is 
infeasible, or obtain an optimal solution y, within the claimed time complexity. As 
shown in the proof of Theorem l2.2l if this problem is infeasible, then so is the original 
program, and we are done. So assume we have obtained an optimal solution y. 

For k = 1,... ,t consider the symmetric n^-fold program 

min i Y * e 4) G ^ x* = ?/\ Ax^ = b\ /^ < x* < n\ i E h 

V i^Ik 

As shown in the proof of Theorem 12.21 this program is feasible. Since this is a huge 
symmetric program, that is, with a single type, by Proposition 13.11 we can compute 
in polynomial time a compact presentation A^ with |supp(A^)| < 2^^ of an optimal 
solution (x* : z G 4) G (In fact, any point in that program has the same 

objective function value = w^y^ and is optimal to that program.) Then 

A^,...,A^ obtained from all these programs provide a compact presentation of a 
point X = (x^,... ,x”) feasible in the original program. We claim this x is optimal. 
Suppose indirectly there is a better point x and dehne y hy y^ = 
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Then we have 


E 

k=l 


w'-t 


= EE 

k=l iGlk 


w^x' 


<EE 

k=l iGlk 




E 

k=l 




contradicting the optimality of y in the t-fold program. So indeed A^,..., A* provide 
a compact presentation of an optimal solution of the given huge n-fold program. □ 

We make the following remark. The algorithm of Theorem 12.21 for the feasibility 
problem involves only one application of the classical n-fold integer programming 
algorithm of Proposition 11.21 In contrast, the algorithm of Theorem 11.31 is much 
heavier, and in addition to one application of classical n-fold integer programming, 
uses t times the algorithm of Proposition 13.11 for huge n-fold integer programming 
with one type, which in turn uses the heavy algorithm for integer cones of [6] . 


4 Tables 

We now return to tables. Consider hrst 3-way I x m x n tables. Index each table 
as X = (x^,..., x”) with x* = {x\ i,..., x^ ^) . Then the table problem is the n-fold 

program with matrix with Ai^m the vertex-edge incidence matrix of the bipartite 
graph Ki^rn- Indeed, then = 9 provides the vertical line-sum equations, and 

with = (e^, provides the column and row sum equations for i G Ik- 
Since is totally unimodular. Theorem 11.31 implies our following claimed result. 

Theorem ll.il The huge 3-way table problem with a variable number t of types can he 
solved in time which is polynomial in t and in the binary encoding ofw’^,e^,f’^,g,nk- 
In particular, deciding if there is a huge table with variable number of types is in P. 

Let us continue with 4-way k x I x m x n tables. Index each table as 
X = (x^,..., x”) with each x^ an kxlxm layer. Then the table problem is the n-fold 
program with matrix At”! where A = Now, unfortunately, for k,l,m > 3, the 
matrix A is not totally unimodular. Therefore, the results of the previous sections 
do not apply, and we remain with the results of HH, which are as follows. 

Proposition 4.1 The huge A-way table problem with fixed number t of types is 
solvable in time polynomial in the binary encoding of and the line sums. 

Moreover, deciding if there is a huge table with t variable is in NP intersect coNP. 

The contrast between Theorem o and Proposition 14.11 motivates the following. 

Open problem. What is the complexity of deciding feasibility of huge 4-way tables 
with a variable number of types ? In particular, is it in P for 3 x 3 x 3 x n tables ? 
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